Analytic-geometric methods for finite Markov chains with applications to quasi-stationarity
نویسندگان
چکیده
منابع مشابه
Quasi-stationarity of Discrete-time Markov Chains with Drift to Infinity
We consider a discrete-time Markov chain on the non-negative integers with drift to innnity and study the limiting behaviour of the state probabilities conditioned on not having left state 0 for the last time. Using a transformation, we obtain a dual Markov chain with an absorbing state such that absorption occurs with probability 1. We prove that the state probabilities of the original chain c...
متن کاملNew Methods for Determining Quasi-Stationary Distributions for Markov Chains
we shall be concerned with the problem of determining quasi-stationary distributions for Markovian models directly from their transition rates Q. We shall present simple conditions for a p-invariant measure m for Q to be p-invariant for the transition function, so that if m is finite, it can be normalized to produce a quasi-stationary distribution. @ 2000 Elsevier Science Ltd. All rights reserv...
متن کاملQuasi-stationarity and quasi-ergodicity of General Markov Processes
In this paper we give some general, but easy-to-check, conditions guaranteeing the quasistationarity and quasi-ergodicity of Markov processes. We also present several classes of Markov processes satisfying our conditions. AMS 2010 Mathematics Subject Classification: Primary 60F25, 60J25G20; Secondary 60J35, 60J75
متن کاملA geometric invariant in weak lumpability of finite Markov chains
We consider weak lumpability of finite homogeneous Markov chains, that is when a lumped Markov chain with respect to a partition of the initial state space is also a homogeneous Markov chain. We show that weak lumpability is equivalent to the existence of a direct sum of polyhedral cones which is is positively invariant by the transition probability matrix of the original chain. It allows us, i...
متن کاملContinuous Markov equilibria with quasi-geometric discounting
We prove that the standard quasi-geometric discounting model used in dynamic consumer theory and political economics does not possess continuous Markov perfect equilibria (MPE) if there is a strictly positive lower bound on wealth. We also show that, at points of discontinuity, the decision maker strictly prefers lotteries over the next period’s assets. We then extend the standard model to have...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Latin American Journal of Probability and Mathematical Statistics
سال: 2020
ISSN: 1980-0436
DOI: 10.30757/alea.v17-35